Goto

Collaborating Authors

 Falmouth


Construction Grammar and Language Models

Madabushi, Harish Tayyar, Romain, Laurence, Milin, Petar, Divjak, Dagmar

arXiv.org Artificial Intelligence

Recent progress in deep learning and natural language processing has given rise to powerful models that are primarily trained on a cloze-like task and show some evidence of having access to substantial linguistic information, including some constructional knowledge. This groundbreaking discovery presents an exciting opportunity for a synergistic relationship between computational methods and Construction Grammar research. In this chapter, we explore three distinct approaches to the interplay between computational methods and Construction Grammar: (i) computational methods for text analysis, (ii) computational Construction Grammar, and (iii) deep learning models, with a particular focus on language models. We touch upon the first two approaches as a contextual foundation for the use of computational methods before providing an accessible, yet comprehensive overview of deep learning models, which also addresses reservations construction grammarians may have. Additionally, we delve into experiments that explore the emergence of constructionally relevant information within these models while also examining the aspects of Construction Grammar that may pose challenges for these models. This chapter aims to foster collaboration between researchers in the fields of natural language processing and Construction Grammar. By doing so, we hope to pave the way for new insights and advancements in both these fields.


Critics say AI can threaten humanity, but ChatGPT has its own doomsday predictions

FOX News

The "CyberGuy" Kurt Knutsson says people should embrace but be "terrified of" ChatGPT and warns that TikTok can track people even if the app is not downloaded. As tech experts warn that the rapid evolution of artificial intelligence could threaten humanity, OpenAI's ChatGPT weighed in with its own predictions on how humanity could be wiped off the face of the Earth. Fox News Digital asked the chatbot to weigh in on the apocalypse, and it shared four possible scenarios how humanity could ultimately be wiped out. "It's important to note that predicting the end of the world is a difficult and highly speculative task, and any predictions in this regard should be viewed with skepticism," the bot responded. "However, there are several trends and potential developments that could significantly impact the trajectory of humanity and potentially contribute to its downfall."


Explosive Proofs of Mathematical Truths

Viteri, Scott, DeDeo, Simon

arXiv.org Artificial Intelligence

Mathematical proofs are both paradigms of certainty and some of the most explicitly-justified arguments that we have in the cultural record. Their very explicitness, however, leads to a paradox, because their probability of error grows exponentially as the argument expands. Here we show that under a cognitively-plausible belief formation mechanism that combines deductive and abductive reasoning, mathematical arguments can undergo what we call an epistemic phase transition: a dramatic and rapidly-propagating jump from uncertainty to near-complete confidence at reasonable levels of claim-to-claim error rates. To show this, we analyze an unusual dataset of forty-eight machine-aided proofs from the formalized reasoning system Coq, including major theorems ranging from ancient to 21st Century mathematics, along with four hand-constructed cases from Euclid, Apollonius, Spinoza, and Andrew Wiles. Our results bear both on recent work in the history and philosophy of mathematics, and on a question, basic to cognitive science, of how we form beliefs, and justify them to others.


Evolving Self-supervised Neural Networks: Autonomous Intelligence from Evolved Self-teaching

Le, Nam

arXiv.org Artificial Intelligence

This paper presents a technique called evolving self-supervised neural networks - neural networks that can teach themselves, intrinsically motivated, without external supervision or reward. The proposed method presents some sort-of paradigm shift, and differs greatly from both traditional gradient-based learning and evolutionary algorithms in that it combines the metaphor of evolution and learning, more specifically self-learning, together, rather than treating these phenomena alternatively. I simulate a multi-agent system in which neural networks are used to control autonomous foraging agents with little domain knowledge. Experimental results show that only evolved self-supervised agents can demonstrate some sort of intelligent behaviour, but not evolution or self-learning alone. Indications for future work on evolving intelligence are also presented.


The New Picasso? Meet Ai-Da the Robot Artist

U.S. News

FALMOUTH, England (Reuters) - Can robots be creative? British gallery owner Aidan Meller hopes to go some way towards answering that question with Ai-Da, who her makers say will be able to draw people from sight with a pencil in her bionic hand.